Hierarchical Dirichlet Processes with Random Effects
نویسندگان
چکیده
Data sets involving multiple groups with shared characteristics frequently arise in practice. In this paper we extend hierarchical Dirichlet processes to model such data. Each group is assumed to be generated from a template mixture model with group level variability in both the mixing proportions and the component parameters. Variabilities in mixing proportions across groups are handled using hierarchical Dirichlet processes, also allowing for automatic determination of the number of components. In addition, each group is allowed to have its own component parameters coming from a prior described by a template mixture model. This group-level variability in the component parameters is handled using a random effects model. We present a Markov Chain Monte Carlo (MCMC) sampling algorithm to estimate model parameters and demonstrate the method by applying it to the problem of modeling spatial brain activation patterns across multiple images collected via functional magnetic resonance imaging (fMRI).
منابع مشابه
A Hierarchial Dirichlet Process Prior
By taking the governing measure of a Dirichlet process as essentially the realization of a Dirichlet process itself, a hierarchical Dirichlet process emerges. This distribution enables the Bayesian treatment of two level hierarchical random effects models, with results paralleling those of Ferguson (1973).
متن کاملClustering in linear mixed models with approximate Dirichlet process mixtures using EM algorithm
In linear mixed models, the assumption of normally distributed random effects is often inappropriate and unnecessarily restrictive. The proposed approximate Dirichlet process mixture assumes a hierarchical Gaussian mixture that is based on the truncated version of the stick breaking presentation of the Dirichlet process. In addition to the weakening of distributional assumptions, the specificat...
متن کاملBorrowing strengh in hierarchical Bayes: Posterior concentration of the Dirichlet base measure
This paper studies posterior concentration behavior of the base probability measure of a Dirichlet measure, given observations associated with the sampled Dirichlet processes, as the number of observations tends to infinity. The base measure itself is endowed with another Dirichlet prior, a construction known as the hierarchical Dirichlet processes (Teh et al. [J. Amer. Statist. Assoc. 101 (200...
متن کاملar X iv : 1 30 1 . 08 02 v 3 [ m at h . ST ] 2 9 Ja n 20 15 Borrowing strengh in hierarchical Bayes : convergence of the Dirichlet base measure 1
This paper studies posterior concentration behavior of the base probability measure of a Dirichlet measure, given observations associated with the sampled Dirichlet processes, as the number of observations tends to infinity. The base measure itself is endowed with another Dirichlet prior, a construction known as the hierarchical Dirichlet processes [Teh et al., 2006]. Convergence rates are esta...
متن کاملIntroduction to the Dirichlet Distribution and Related Processes
This tutorial covers the Dirichlet distribution, Dirichlet process, Pólya urn (and the associated Chinese restaurant process), hierarchical Dirichlet Process, and the Indian buffet process. Apart from basic properties, we describe and contrast three methods of generating samples: stick-breaking, the Pólya urn, and drawing gamma random variables. For the Dirichlet process we first present an inf...
متن کامل